Papers with style-aware contrastive learning
Style-Aware Contrastive Learning for Multi-Style Image Captioning (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing multi-style image captioning methods focus on visual content and style . existing methods overlook the relationship between linguistic style and visual content. |
| Approach: | They propose a style-aware visual encoder with contrastive learning to mine potential visual content relevant to style and a triplet contrast objective to distinguish whether the image, style and caption matched. |
| Outcome: | The proposed method achieves state-of-the-art performance and an extensive analysis to verify its effectiveness. |